On the construction of Lyapunov functions for nonlinear Markov processes via relative entropy
نویسندگان
چکیده
We develop an approach to the construction of Lyapunov functions for the forward equation of a nite state nonlinear Markov process. Nonlinear Markov processes can be obtained as a law of large number limit for a system of weakly interacting processes. The approach exploits this connection and the fact that relative entropy de nes a Lyapunov function for the solution of the forward equation for the many particle system. Candidate Lyapunov functions for the nonlinear Markov process are constructed via limits, and veri ed for certain classes of models.
منابع مشابه
Relative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain
In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...
متن کاملLyapunov functionals for boundary-driven nonlinear drift–diffusion equations
We exhibit a large class of Lyapunov functionals for nonlinear drift–diffusion equations with non-homogeneous Dirichlet boundary conditions. These are generalizations of large deviation functionals for underlying stochastic manyparticle systems, the zero-range process and the Ginzburg–Landau dynamics, which we describe briefly. We prove, as an application, linear inequalities between such an en...
متن کاملNonlinear Markov Processes in Big Networks
Big networks express multiple classes of large-scale networks in many practical areas such as computer networks, internet of things, cloud computation, manufacturing systems, transportation networks, and healthcare systems. This paper analyzes such big networks, and applies the mean-field theory and the nonlinear Markov processes to constructing a broad class of nonlinear continuous-time block-...
متن کاملCOVARIANCE MATRIX OF MULTIVARIATE REWARD PROCESSES WITH NONLINEAR REWARD FUNCTIONS
Multivariate reward processes with reward functions of constant rates, defined on a semi-Markov process, first were studied by Masuda and Sumita, 1991. Reward processes with nonlinear reward functions were introduced in Soltani, 1996. In this work we study a multivariate process , , where are reward processes with nonlinear reward functions respectively. The Laplace transform of the covar...
متن کاملThe Relative Entropy Rate For Two Hidden Markov Processes
The relative entropy rate is a natural and useful measure of distance between two stochastic processes. In this paper we study the relative entropy rate between two Hidden Markov Processes (HMPs), which is of both theoretical and practical importance. We give new results showing analyticity, representation using Lyapunov exponents, and Taylor expansion for the relative entropy rate of two discr...
متن کامل